Display of media asset information

ABSTRACT

An enhanced metadata structure and associated process is provided which captures and stores metadata gathered about the source and usage of a media asset or file. The source and usage metadata is integrated, such as by encoding within the enhanced media file, as the media asset is transferred and used. The integrated metadata accumulates, as a trail of source information and usage information in the enhanced media asset, and can be extracted upon arrival at a target computer system.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. patent application Ser. No.13/789,078, filed on Mar. 7, 2013, which is a continuation of U.S.patent application Ser. No. 13/420,446, filed on Mar. 14, 2012, which isa continuation of U.S. patent application Ser. No. 13/082,277, filed onApr. 7, 2011, now issued as U.S. Pat. No. 8,150,892, which is acontinuation of U.S. patent application Ser. No. 12/782,258, filed onMay 18, 2010, now issues as U.S. Pat. No. 7,937,412, which is acontinuation of U.S. patent application Ser. No. 11/733,687, filed onApr. 10, 2007, now issued as U.S. Pat. No. 7,747,603, which is acontinuation of U.S. patent application Ser. No. 10/640,680, filed onAug. 12, 2008, now issued as U.S. Pat. No. 7,213,036. The contents ofeach of the aforementioned applications and patents are herebyincorporated by reference in their entirety.

FIELD OF THE INVENTION

The invention relates to the integration of metadata within a mediaasset. More particularly, the invention relates to the integration ofsource and usage information within a distributed media asset.

BACKGROUND OF THE INVENTION

Media asset files are often sent from a source to one or morerecipients, typically without further modification. The received filesare typically stored within a recipient computer, such as within adirectory and/or folder. The only metadata associated with a stored filethat is typically retained and possibly recalled is that of a filenameand file creation or modification date. In some operating environments,applications allow annotations to be added to the files themselves.

Through the passage of time, however, information regarding the sourceor subsequent use of a file is typically lost or forgotten. A recipientof a file therefore commonly has little or no idea of the origin orprevious use or distribution of a stored file.

Furthermore, while some asset management systems externally indexmetadata about collections of files and how the files are used, as thefiles are transferred between computers, e.g. such as through an emailtransmission, any associated metadata that was previously captured isnot included, such that the metadata is lost.

Information that is generally overlooked is the source of a media assetor file. For example, the original source, e.g. such as a particularcamera and/or the identity of the creator, i.e. photographer, for aparticular media asset, e.g. a photograph, is often not captured orstored for future use. Even if such source information is noted, it istypically not distributed when the media is sent to one or morerecipients.

Other information that is often overlooked comprises the distributionchannels and distribution times of a media asset or file. For example,while a file may be transferred between a plurality of users, therecipients and dates of transmission are not typically noted.

While such source and usage information is frequently lost in connectionto a media asset or file, such source and usage information is often ofgreat value to a user or recipient of a file. For example, a recipientof a family photograph may or may not be able to recall the source orusage information of the photograph. The recipient of the photograph mayeasily never know or lose track of the identity of the source device,e.g. the camera, used to create the photograph. The recipient of thephotograph similarly lose track of the distribution of the photograph,i.e. how the recipient came into possession of the photograph.

Such source and usage information is often the most useful metadata forthe user in helping them find a media file, based on what the userremembers about a file, e.g. the picture the recipient received fromtheir mother last April, which the mother received from an uncle themoth before, that the uncle took with his digital camera the monthbefore. Unless a trail of source and usage is sent along with the mediaitself, then the full story of the media's history is lost.

Some current image metadata formats, e.g. Exif headers in JPEG and TIFFimages, currently allow the storage of a metadata associated with animage, regarding the original creation of a photograph, such as devicemake, device model, and/or a photographer name. While such imagemetadata may provide basic information regarding the origin, i.e.creation, of an image, such header information does not include ongoing,i.e. dynamic, usage information of the image by the original source, nordoes such information provide an audit trail for subsequent recipients,further usage, and/or transfer information.

Several structures and methods have been described for the use ofmetadata in a network environment.

T. Johnson and Z. Qian, Methods and System for Encoding and Decoding aMedia Sequence, U.S. Patent Application Publication No. 2002/0165720 A1,describe “A method of encoding a media sequence with at least one appletobject provided. The applet object is inserted into at least one FMOfile. A media sequence is provided with a media file. The FMO file isintegrated into the media file and a synchronous bit is inserted. Afurther method encompasses decoding a media sequence.”

K. Milsted, K. Nguyen, and Q. Gong, Method and Apparatus to CreateEncoded Digital Content, U.S. Pat. No. 6,263,313 B1, describe “A methodof automatically selecting processing parameters for encoding digitalcontent. Metadata containing the genre of the digital content, receivingthe compression level selected for encoding the digital content isreceived. An algorithm selected for encoding the digital content isreceived. And a previously defined table to select the processingparameters for encoding the digital content based on the genre of thecontent, the compression level selected and the algorithm selected isindexed and the processing parameters are retrieved. In accordance withanother aspect of the invention, an apparatus is described to carry outthe above method.”

D. Reed, P. Heymann, S. Mushero, K. Jones, J. Oberlander, and D. Banay,Computer-Based Communication System and Method Using Metadata Defining aControl-Structure, U.S. Pat. No. 6,345,288 B1, describe “An automatedcommunications system operates to transfer data, metadata and methodsfrom a provider computer to a consumer computer through a communicationsnetwork. The transferred information controls the communicationsrelationship, including responses by the consumer computer, updating ofinformation, and processes for future communications. Information whichchanges in the provider computer is automatically updated in theconsumer computer through the communications system in order to maintaincontinuity of the relationship. Transfer of metadata and methods permitsintelligent processing of information by the consumer computer andcombined control by the provider and consumer of the types and contentof information subsequently transferred. Object oriented processing isused for storage and transfer of information. The use of metadata andmethods further allows for automating may of the actions underlying thecommunications, including communication acknowledgements and archivingof information. Service objects and partner servers provide specializeddata, metadata, and methods to providers and consumers to automate manycommon communications services and transactions useful to both providersand consumers. A combination of the provider and consumer programs anddatabases allows for additional functionality, including coordination ofmultiple users for a single database.”

L. Valdez Jr., System and Method for Providing Interactive Components inMotion Video, U.S. Pat. No. 6,426,778 B1, describes “An editing systemand delivery system synchronizes the transmission of interactiveelements with a video signal, such that the interactive components maysupplement information provided in the video signal at predefinedperiods. The interactive elements are transmitted in relation to thevideo such that the interactive elements will arrive in time to displaythe components concurrently with a portion of the video presentation.The interactive elements may be transmitted within a video signal to aviewer. The viewer is configured to display the interactive elements inresponse to a signal from the delivery system. An editing system isdisclosed that may define a programming track for interactive elementsthat may be associated with one or more audio and video tracks. Theediting system schedules transmission and appearance of the elements. Agraphical user interface of the editing system may display a time in apresentation timeline when the interactive elements appear and theduration which the interactive elements are displayed. Graphical userinterface representations of the interactive elements are translatedinto commands including file transfer instructions to be executed on aplayback system. The playback system may transmit information elementdata within a video signal to a viewer.”

S. Barile, Method and System for Embedding Audio Titles, U.S. Pat. No.6,448,485, describes “A system and method for embedding audio titles ispresented. Information encoded in a format is received about an audioprogram. The information is transformed into an audio signal conveyingan audio description about the audio program. The audio description andthe audio program are then embedded in a predetermined format.”

M. Mowman-Amuah, Self-Described Stream in a Communication ServicesPatterns Environment, U.S. Pat. No. 6,477,580 B1, describes “A system,method, and article of manufacture are described for providing aself-describing stream-based communication system. Messages are sentwhich include data between a sending system and a receiving system.Meta-data is attached to the messages being sent between the sendingsystem and the receiving system. The data of the messages sent from thesending system to the receiving system is translated based on themeta-data. The meta-data includes first and second sections. The firstsection identifies a type of object associated with the data and anumber of attribute descriptors in the data. The second section includesa series of the attribute descriptors defining elements of the data.”

Other structures and methods have also been described for the metadataand electronic content, such as Customization of Electronic ContentBased On Consumer Attributes, European Patent No. 1 126 392 A2, A3;Method for Adding Personalized Metadata to a Collection of DigitalImages, European Patent No. 1 209 589 A2; and I. Foster et al., TheVirtual Data Grid: A New Model and Architecture for Data-IntensiveCollaboration, Department of Computer Science, University of Chicago.

Other structures and methods have also been described for the creation,storage, and distribution of content, such as Method for ImageRetrieval, European Patent No. 1 217 823 A2, A3; Method and System forManaging Images Over a Communication Network, European Patent No. 1 278364 A2; Meta-Document Management System with User DefinablePersonalities, European Patent No. 1 284 461 A1; System, Method andSoftware Product for Allowing a Customer to Order Image Products Over aCommunication Network From a Plurality of Different Providers, EuropeanPatent No. 1 288 827 A1; Re-Usable Database System, European Patent No.0 968 476 B1; Y. Gordon and J. Ludington, System for Managing theAddition/Deletion of Media Assets Within a Network Based on Usage andMedia Asset Metadata, U.S. Pat. No. 5,920,700; T. Barry and F. Lane,Data Repository with User Accessible and Modifiable Reuse Criteria, U.S.Pat. No. 6,003,039; S. Gustman, Digital Library System, U.S. Pat. No.6,092,080; R. Hopwood, B. Sipes, T. Wayne, J. Quarton, and S. Milus,Computer System and Method to Track and Control Element ChangesThroughout Application Development, U.S. Pat. No. 6,223,343 B1; E.Downs, G. Gruse, M. Hurtado, C. Lehman, K. Milsted, and J. Lotspiech,Electronic Content Delivery System, U.S. Pat. No. 6,226,618 B1; R.Swartz, J. Winkler, E. Janos, I. Markidon, and Q. Dou, Method andApparatus for the Integration of Information and Knowledge, U.S. Pat.No. 6,236,994; D. Glowny, P. Ni, and J. Richter, System and Method forIntegrating Call Record Information, U.S. Pat. No. 6,252,946 B1; D.Diamond, D. Glowny, T. Nguyen, P. Ni, and J. Richter, System and Methodfor Data Recording and Playback, U.S. Pat. No. 6,252,947 B1; K. Milsted,C. Kindell, and Q. Gong, Automated Method and Apparatus to PackageDigital Content for Electronic Distribution Using the Identity of theSource Content, U.S. Pat. No. 6,345,256 B1; S. Gustman, Digital LibrarySystem, U.S. Pat. No. 6,353,831 B1; R. Jain, C. Fuller, M. Gorkani, B.Horowitz, R. Humphrey, M. Portuesi, and C. Shu, Video Cataloger Systemwith Synchronized Encoders, U.S. Pat. No. 6,360,234 B2; H. St. John,Method of Modifying a Populated Database Structure by Modifying MetadataDescribing the Database Structure, U.S. Pat. No. 6,366,917 B1; E.Hoffert, K. Cremin, A. Ali, S. Smoot, and B. Strull, Method andApparatus for Uploading, Indexing, Analyzing, and Searching MediaContent, U.S. Pat. No. 6,374,260 B1; C. Beck, J. Berke, J. Johnstone, R.Mitchell, J. Powers, M. Sidell, and C. Knuff, Method and Apparatus forAutomated Personalization and Presentation of Workload Assignments toAgents within a Multimedia Communication Center, U.S. Pat. No. 6,381,640B1; System for Tracking End-User Electronic Content Usage, U.S. Pat. No.6,389,538 B1; System, Method and Article of Manufacture for a PersistentState and Persistent Object Separation in and Information ServicesPatterns Environment, U.S. Pat. No. 6,442,748 B1; Content ManagementTool and Service Table Database with Unique Service Entries EachAssociated with a Set of Record Tables with Record Entries IncludingLinks to Shared Record Entries in Other Tables, U.S. Pat. No. 6,466,941B1; K. Levy and G. Rhoads, Connected Audio and Other Media Objects, U.S.Pat. No. 6,505,160 B1; D. Harvey, Y. Pandya, J. Anigbogu, J. Provost, J.Alvarado, D. Scheibner, S. Kanvinde, B. Fogelsong, and K. Kaan, Systemand Method for Electronic Data Delivery, U.S. Pat. No. 6,519,568 B1; M.Liu, M. Stokes, and G. Wong, Infrastructure and Method for SupportingGeneric Multimedia Metadata, U.S. Pat. No. 6,523,046 B2; M.Bowman-Amuah, Method for Translating an Object Attribute Converter in anInformation Services Patterns Environment, U.S. Pat. No. 6,529,909 B1;M. Bowman-Amuah, Multi-Object Fetch Component, U.S. Pat. No. 6,529,948B1; M. Bowman-Amuah, Multi-Object Identifier System and Method forInformation Service Pattern Environment, U.S. Pat. No. 6,539,396 B1; Y.Cui et al, Tracing the Lineage of View Data in a WarehousingEnvironment, Computer Science Department, Stanford University; Y. Cui etal, Storing Auxiliary Data for Efficient Maintenance and Lineage Tracingof complex Views, Computer Science Department, Stanford University; F.Wang et al., Preserving and Querying Histories of XML-PublishedRelational Databases, Department of Computer Science, University ofCalifornia, Los Angeles; and M. Watanabe et al, An Image Data FileFormat for Digital Still Camera, Final Program and Advance Printing ofPapers, IS&T's 48^(th) Annual Conference, Imaging on the Superhighway.

While simple information, such as a file name and/or creation date maybe captured and transferred with a file or media asset, a recipient of amedia asset does not currently have a comprehensive trail of sourceinformation and/or usage of a media asset. It would be advantageous toprovide a system and an associated method which incorporates informationabout the source and usage of a media asset within the media assetitself. The development of such a system would constitute a majortechnological advance.

As well, while some software applications include user definablemetadata, such as to a creation date and/or a last modification date,there is currently no structure and associated process to capture andstore source information and/or usage information within the asset, toprovide an automated audit trail which can be selectively extracted atany point of distribution. The development of such a system andassociated process would constitute a further major technologicaladvance.

SUMMARY OF THE INVENTION

An enhanced metadata structure and associated process is provided whichcaptures and stores metadata gathered about the source and usage of amedia asset or file. The source and usage metadata is integrated, suchas by encoding within the enhanced media file, as the media asset istransferred and used. The integrated metadata accumulates, as a trail ofsource information and usage information in the enhanced media asset,and can be extracted upon arrival at a target computer system. Someembodiments of the enhanced metadata structure and associated processalso comprise the accumulation of transfer information metadata.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a schematic view of a content file having an integrated audittrail metadata;

FIG. 2 is a flowchart of a process for the incorporation of enhancedmetadata;

FIG. 3 shows a file content source and sequential transmission andusage;

FIG. 4 is a schematic view of a variety of file content sources andsequential transmission and usage at one or more node terminals;

FIG. 5 shows alternate source content;

FIG. 6 is a detailed schematic view of the display of source and usageinformation associated with a media asset file;

FIG. 7 is a schematic view of an alternate enhanced content file havingaudit trail metadata which is integrated or encoded within the mediaasset; and

FIG. 8 is a schematic view of a combined internal and external metadatastorage system.

DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS

FIG. 1 is a schematic view 10 of an enhanced content file 12 havingintegrated audit trail metadata 16. The enhanced content file 12comprises a media asset 14, as seen in FIG. 5, such as but not limitedto image content 14 a, video content 14 b, text content 14 c, soundcontent 14 d, page layout content 14 e, pixel-based content 14 f,vector-based content 14 g, animation content 14 h, data content, and/ormultimedia content 14 p.

In addition to the source media asset 14, the enhanced media asset file12 further comprises metadata 16, which comprises source, i.e. node,information 18 a-18 n, which may further comprise usage information 24a-24 k at any of the source nodes 18 a-18 n. As well, the metadata shownin FIG. 14 further comprises transfer information 26 a-26 m, such as thedate and/or time of transfer 50 (FIG. 2) of the enhanced content file 12between nodes 18. For example, transfer information 26 a shown in FIG. 1typically comprises the transfer date from the original source node 18 ato a second source node 18 b.

As seen in FIG. 1, the metadata 16 comprises a comprehensive audit trailof the source media asset 14, which adds great value to an enhancecontent file 12 as the file is transferred from a sender, i.e. source,node 18 to a recipient node 18, as the media asset is used 24 a-24 k atany of the nodes 18 a-18 n, and as subsequent recipient nodes 18 a-18 nact as source nodes 18 upon transfer to other recipient nodes 18.

The first source information 18 a shown in FIG. 1 comprises a variety ofinformation regarding the original source 18 a and creation of the filecontent 14, such as source identification (ID) 20 a, source type 20 b,source creator 20 c, source date 20 d, source time 20 e, and/or othersource information 22 j. As well, the first source information 18 ashown in FIG. 1 preferably comprises usage information 24 a-24 k of thefile content 14 by the first, i.e. original source 18 a.

In some system embodiments 10, 110 (FIG. 7), 120 (FIG. 8), the type ofsource identification information 20 a that is associated with eachsource entity 18 depends on the type of the source 18. For example, fora person 92, e.g. 92 a in FIG. 4, the identification information 20 atypically comprises a name, an e-mail address, and/or a screenname.Similarly, for a node 18 comprising a device 62 (FIG. 3) or terminal 70(FIG. 3, FIG. 4), the identification information 20 a typicallycomprises manufacturer information, model information, and or a globallyunique identifier for the physical device 62,70. Furthermore, for a node18 which comprises a web site, the identification information 20 atypically comprises a source URL, a containing URL, and/or an author.

While the first source 18 a comprises the original, i.e. creator, ofcontent 14, subsequent sources 18, e.g. 18 b-18 n comprise ongoingnodes, where each node 18 further comprises a source entity, such as adevice 62,70 (FIG. 3, FIG. 4), a person 92, e.g. 92 a,92 b (FIG. 4),and/or a website, through which the content 14 is distributed andpossibly used.

For example, if a first person 92 a, e.g. Sally, in FIG. 4 takes aphotograph asset 14 with a camera 62 a, the source creator 22 b maycomprise the identity of the camera 62 a. Similarly, the source type 22a of camera 62 a shown in FIG. 4 is the identity of the camera 62 a usedto create the photograph 14.

The exemplary source information 18 shown in FIG. 1 comprisesinformation regarding the subsequent use 24 a-24 k of the content 14, asthe content 14 is distributed to one or more recipients. If the firstperson 92 a uses or modifies the photograph asset 14, the usage 24 isnoted 24 a-24 k within the metadata source node 18 b. Similarly, if asubsequent person 92 n uses or modifies the photograph asset 14, theusage 24 is noted 24 a-24 k within the metadata source node information18 n.

FIG. 2 is a flowchart of a process 40 for the incorporation and use ofenhanced metadata 16 within an enhanced media asset 12. A media asset 14is provided or created 42, and source information 18 is established 44in regard to the media asset 14 at each node 18. Information regardingeach source node 18 is then integrated 46 with the media asset 14, suchas through encoding, whereby the source information 18 a-18 n isretained with the media asset 14, such as through distribution 86 (FIG.3) and/or subsequent use 24 a-24 k.

Usage information 24 a-24 k is added 48 to the metadata 16 at any node18 a-18 n where the asset is used 24. For example, usage 24 may compriseprocessing or modification to the asset, or may comprise otherinformation 24 that is added at a node 18, such as a rating by a user 92(FIG. 4).

As seen in FIG. 2, as the enhanced media asset 12 (FIG. 1) istransmitted, sent, or distributed 50 to one or more users, transmissioninformation 26 (FIG. 1) is preferably captured and added 52 to themetadata 16, to provide details of the transfer of the enhanced mediaasset 12. In some enhanced media assets 12, transfer information 26comprises a transfer date and/or time at which the enhanced media asset12 is sent to a subsequent node 18. In alternate enhanced media assets12, the transfer information 26 may also comprise distribution channelinformation, such as a log of electronic communication.

As the enhanced media asset 12 is sent and used, the source information18 a-18 n, which may include usage information 24 a-24 k and/or transferinformation 26 a-26 m, is added to the metadata 16 within the enhancedmedia asset 12, such that a usage audit trail 48 is incorporated withinthe asset itself. The metadata 16, comprising reiterative source 18 a-18n, usage information 24, and transfer information 26, is integrated,such as through encoding, in conjunction with the media asset 14.

The source and usage information is selectively accessed 58 at one ormore points during the creation 42, distribution, and subsequent use 30of the enhanced media asset 12, in which the source information 18 andusage information 28 is extracted 58. Therefore, at any point in thedistribution 50 and use 24 of a media asset 14, a user may selectivelyextract 58 a comprehensive audit trail of metadata 16 associated withthe source nodes 18 a-18 n and usage 24 of the media asset 14.

As well, the exemplary source information 18 shown in FIG. 1 comprises avariety of information regarding the use and/or distribution 30, e.g. 30a-30 n of the file content 14, comprising one or more uses 30 a-30 n,associated usage identifiers 32 a-32 n, and usage information 34 a-34 kcorresponding with each use 32.

The enhanced media asset 12 and associated process 40 (FIG. 2) takes thetrail of metadata gathered about the source 18 and use 28 of the mediafile 12, and integrates or encodes that metadata 18,28 into the mediafile 12, before sending the file 12 to another computer system 70 (FIG.3). This metadata 18,28 then accumulates as a trail of sourceinformation 18 and usage information 28 in the file itself, which can beextracted 56 (FIG. 2) upon arrival in the target computer system 40. Insome system embodiments 12, the encoding of metadata 16 and attachmentto media asset files 14 is provided through conventional file taggingschemes.

FIG. 3 is a sequential schematic view 60 of a file content source 62 andsequential transmission 86 and usage 84 at one or more user terminals70, e.g. such as user terminals 70 a-70 n. FIG. 4 is a sequentialschematic view 90 of a variety of file content sources 62 a-62 j andsequential transmission 86 a-86 n and usage 84 at one or more nodeterminals 70 a-70 n. Each terminal 70, e.g. 70 a-70 n, typicallycomprises a central processing unit (CPU) 72, a user or terminal ID 76,e.g. such as a unique IP address, a screen name, an email address, or auser identity 76. Each terminal 70 shown in FIG. 3 and FIG. 4 alsotypically comprises media access software 74, a display 78, and a userinterface 79, typically comprising a keyboard 80 and a pointing device84 associated with a user graphic display 84, though which a media asset14 and/or associated metadata 16 may be accessed.

While the exemplary terminals 70, e.g. 70 a-70 n, shown in FIG. 3 andFIG. 4 are shown as computer terminals 70, the media asset 14 and/orassociated metadata 16 may be used and accessed by a wide variety ofdevices, such as but not limited to portable computers, portable digitalassistants, or other wired or wireless, i.e. mobile, devices 70associated with the reception, use, presentation, and/or subsequenttransmission 86 of media assets 12,14.

The source device 62 shown in FIG. 3 comprises a media asset creator 64,e.g. such as but not limited to software or hardware. For example, for asource device comprising a digital camera 62 a, a digital video camera62 c, or a digital scanner 62 j (FIG. 4), the media asset creator maycomprise image capture and storage 64 (FIG. 3). Similarly, for a sourcedevice 62 b (FIG. 4) comprising a computer 70, the media asset creatormay comprise illustration software, by which a user composes or createsa source media asset 14.

FIG. 5 is a schematic view 98 which shows a variety of content or assetformats which can be integrated with enhanced metadata 16, such as animage asset 14 a, a video asset 14 b, a text asset 14 c, a sound asset14 d, a page layout asset 14 e, a pixel-based asset 14 f, a vector-basedcontent 14 g, an animation asset 14 h, a data asset, and/or a multimediaasset 14 p.

FIG. 6 is a detailed schematic view of the display 100 of source andusage information associated with an enhanced media asset file 12. Amedia asset 14 is typically displayed or played within a media assetwindow 102, while source information 18 usage information 24, and/ortransfer information 26 is typically selectively accessed and displayedwithin one or more metadata display windows 104.

The source information 18, usage information 24, and transferinformation 26 is extractable 58 and/or displayable in a wide variety offormats, such as but not limited to the periphery 104 of the media assetwindow 106, or as an information overlay 108 appearing at any point inthe displayed media asset 14.

In some system embodiments 10,40,110 (FIG. 7), the source information18, usage information 24, and transfer information 26 is alsoexportable, either in context with a single enhanced media asset 12, orin context with a plurality of enhanced media assets 12, e.g. such as toview the sources, distribution, and usage of one or more media assets 12within an electronic publication or website.

As well, the source information 18 and/or usage information 58 that isintegrated or encoded within the enhanced content file 12 a ispreferably searchable, such that a user may readily locate or find adesired media asset 14, such as from within media software 74 (FIG. 3),or externally, such as from search or find utility software.

Alternate System Embodiments

FIG. 7 is a schematic view 110 of an alternate enhanced content file 12a having audit trail metadata 16 which is integrated or encoded withinthe media asset 14. The enhanced metadata 16 is readily integratedwithin the media asset itself, such that is can be extracted 58 (FIG.2), such as selectively by any recipient of the enhanced content file 12a, or securely, such as through the use of a password.

As described above, the content file 12 a may similarly comprise anymedia asset 14, such as but not limited to image content 14 a, videocontent 14 b, text content 14 c, sound content 14 d, page layout content14 e, pixel-based content 14 f, vector-based content 14 g, animationcontent 14 h, data content, and/or multimedia content 14 p.

The enhanced metadata 16 comprises metadata gathered about the sourcenodes 18 a-18 n and use 24 a-24 k of a media asset 12 and encodes thatmetadata 16 into the file content 14 before the enhanced media asset 12is sent to another computer system 70 (FIG. 3). This enhanced metadata16 then accumulates, as a trail of source information 18 a-18 n,transfer information 26 a-26 m between node sources 18 a-18 n, and usageinformation 24 a-24 k at each of the node sources 18 a-18 n. Theaccumulated enhanced metadata 16 is included within the enhanced file12, and can be extracted 58 upon arrival in the target computer system70.

The enhanced metadata structure 10,110 and associated process 90 allowsthe capture and storage of useful information 18,28 about where a mediaasset (or file) comes from, i.e. source information 18 a-18 n, how themedia asset 12 is transferred 26 a-26 m, and how the media asset is used24 a-24 k. The captured information 18,26,24 is incorporated, attached,and/or encoded into the media asset 18, and is retrievable at one ormore destinations, such as to provide a captured audit trail of thesource 18 and usage 28 of the media asset 14.

FIG. 8 is a schematic view of a combined internal and external metadatastorage system 120, comprising a file content source 62 and sequentialtransmission 86 to one or more user terminals 70, e.g. such as userterminals 70 a-70 n, in which an alternate enhanced media asset 12preferably comprises a unique asset identifier ID 122, and in whichmetadata information 124 a-124 k is externally storable 126, such aswithin an external database 126. The asset ID 122 is stored in the asset12, and can be used at any point of distribution 70, to lookup 128additional metadata 124 a-124 k for the asset 12 in the externaldatabase 126.

The asset ID 122 is retained within the asset 12, such that the“identity” of the asset 12 is maintained, even if the asset 12 moves inand out of a closed system governed by the database 126. For example, asseen in FIG. 8, a unique identifier 122 is stored in an image asset 12,whereby the asset identifier 122 is used to access further information124 a-124 k in a database 126, such as within a database 126 for anInternet provider 130. Even if the asset 12 is emailed or otherwise sentto another user 92 (FIG. 3) that does not have access to the database126, e.g. a non-subscriber, of the internet service 130, the asset ID122 continues to be retained within the asset 12. If the asset 12 isresent or forwarded to another user 92 who has access to the database126, the retained access ID 122 metadata allows the recipient, i.e.subscriber, user 92 to access the information 124 a-124 k.

In some embodiments of the combined internal and external metadatastorage system 120, the externally stored metadata may comprise audittrail information 18, 24, 26 for the media asset as it is sent and used,such as through one or more distribution channels. For example, a userat one terminal 70, e.g. 70 a, may distribute a media asset 12 to morethan one recipient node 70. The use of external storage of audit trailinformation provides storage and access for one or more branches ofdistribution and use.

As well, the externally stored metadata 124 a-124 k within the combinedinternal and external metadata storage system 120 may comprise a widevariety of other information 124, such as but not limited to textualannotations for the image 12 provided by different users 92. Users thathave access to the database 126 have access to all previous textualannotations for the asset 12, since the identity 122 of the image 12 ismaintained, in the context of the database 126.

System Advantages.

The enhanced metadata structures 10,110,120 and associated process 40provide a significant value to the creator and subsequent users of amedia asset 14. Through the implementation of the enhanced metadatastructures 10,110,120 and associated process 40, a recipient of a mediaasset 14 also receives and has access to a comprehensive trail of sourceinformation 18 and usage 24 of a media asset 14.

While some software applications include basic user definable metadata,such as a creation date and/or a last modification date, the enhancedmetadata structure 10,110 and associated process 90 captures and storessource information 18 and usage information 24 within the asset 14,which provides an automated audit trail, which may further includetransfer information 26 which can be selectively extracted 58 at anypoint of distribution.

The enhanced metadata structure 10,110 and associated process 90 readilyaccumulates a trail of source information 18 and usage information 26within the enhanced file 12, which is then extractable and/or searchableupon arrival in a target computer system 70.

Although the enhanced metadata structure and methods of use aredescribed herein in connection with personal computers, mobile devices,and other microprocessor-based devices, such as portable digitalassistants or network enabled cell phones, the apparatus and techniquescan be implemented for a wide variety of electronic devices and systems,or any combination thereof, as desired.

Accordingly, although the invention has been described in detail withreference to a particular preferred embodiment, persons possessingordinary skill in the art to which this invention pertains willappreciate that various modifications and enhancements may be madewithout departing from the spirit and scope of the claims that follow.

What is claimed is:
 1. A method comprising: storing, in a non-transitorystorage medium, a metadata portion of a media asset, the metadataportion of the media asset comprising one or more of a date of transferof the media asset, a time of transfer of the media asset, ordistribution channel information corresponding to a transfer of themedia asset; providing a content portion of the media asset for displayto a user, wherein the content portion of the media asset is separatefrom the metadata portion of the media asset; receiving a request toaccess information from the metadata portion of the media asset; andproviding information from the metadata portion of the media asset fordisplay to the user in an overlay over the display of the contentportion of the media asset.
 2. The method of claim 1, wherein storing,in the non-transitory storage medium, the metadata portion of the mediaasset further comprises storing one or more of: source informationassociated with the media asset or usage information associated with themedia asset.
 3. The method of claim 2, wherein the metadata portion ofthe media asset further comprises usage information associated with themedia asset.
 4. The method of claim 3, wherein the usage informationassociated with the media asset comprises one or more annotations madeto the media asset.
 5. The method of claim 4, wherein the media assetcomprises one of a photograph or a video.
 6. The method of claim 3,wherein the usage information associated with the media asset comprisesa rating of the media asset.
 7. The method of claim 2, wherein thesource information associated with the media asset comprises one or moreof: a source creator, a source identification, a source type, a sourcedate, or a source time.
 8. The method of claim 2, wherein the metadataportion of the media asset displayed in the overlay over the display ofthe media asset further comprises one or more of: the source informationassociated with the media asset or the usage information associated withthe media asset.
 9. The method of claim 1, wherein providing the contentportion of the media asset for display to the user comprises providing aplayback of the content portion of the media asset.
 10. A methodcomprising: storing, in a non-transitory storage medium, a metadataportion of a media asset, the metadata portion of the media assetcomprising one or more of a date of transfer of the media asset, a timeof transfer of the media asset, or distribution channel informationcorresponding to a transfer of the media asset; providing a contentportion of the media asset for display to a user in a first interface,wherein the content portion of the media asset is separate from themetadata portion of the media asset; receiving a request to accessinformation from the metadata portion of the media asset; and providinginformation from the metadata portion of the media asset for display tothe user in a second interface near a periphery of the first interface.11. The method of claim 10, wherein storing, in the non-transitorystorage medium, the metadata portion of the media asset furthercomprises storing metadata extracted from an audit trail associated withthe media asset.
 12. The method of claim 11, wherein providing theinformation from the metadata portion of the media asset for display tothe user in the second interface near the periphery of the firstinterface comprises providing the metadata in the second interface nearthe periphery of the first interface.
 13. The method of claim 10,wherein storing, in the non-transitory storage medium, the metadataportion of the media asset further comprises storing one or more of:source information associated with the media asset or usage informationassociated with the media asset.
 14. The method of claim 13, wherein themetadata portion of the media asset further comprises usage informationassociated with the media asset.
 15. The method of claim 14, wherein theusage information comprises an annotation of the media asset.
 16. Themethod of claim 10, wherein the second interface partially overlaps withthe first interface.
 17. A non-transitory computer readable mediumstoring instructions thereon that, when executed by at least oneprocessor, cause a computer system to: store information associated witha metadata portion of a media asset, the metadata portion of the mediaasset comprising one or more of a date of transfer of the media asset, atime of transfer of the media asset, or distribution channel informationcorresponding to a transfer of the media asset; provide a contentportion of the media asset for display to a user, wherein the contentportion of the media asset is separate from the metadata portion of themedia asset; receive a request to access information from the metadataportion of the media asset; and provide the information associated withthe metadata portion of the media asset for display to the user in anoverlay over the display of the content portion of the media asset. 18.The A non-transitory computer readable medium of claim 17, furthercomprising instructions that, when executed by the at least oneprocessor, cause the computer system to receive a request to storeinformation extracted from an audit trail contained in the media asset,the information extracted from the audit trail including one or more of:source information associated with the media asset or usage informationassociated with the media asset.
 19. The non-transitory computerreadable medium of claim 18, wherein the metadata portion of the mediaasset further comprises the information extracted from the audit trail.20. The non-transitory computer readable medium of claim 19, wherein theinformation extracted from the audit trail comprises one or more of:source metadata or usage metadata.